Using Model-Driven Bundle-Adjustment to Model Heads from Raw Video Sequences

نویسنده

  • Pascal Fua
چکیده

We show that we can effectively and automatically fit a complex facial animation model to uncalibrated image sequences. Our approach is based on model-driven bundleadjustment followed by least-squares fitting. It takes advantage of three complementary sources of information: stereo data, silhouette edges and 2–D feature points. In this way, complete head models can be acquired with a cheap and entirely passive sensor, such as an ordinary video camera. They can then be fed to existing animation software to produce synthetic sequences.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Modeling Heads from Uncalibrated Video Sequences

We show that we can e ectively t a very complex facial animation model to uncalibrated video sequences, without bene t of targets, structured light or any other active device. Our approach is based on regularized bundle-adjustment followed by least-squares minimization using a set of progressively ner control triangulations. It takes advantage of three complementary sources of information: ster...

متن کامل

Bundle Adjustment for Stereoscopic 3D

The recent resurgence of stereoscopic 3D films has triggered a high demand for post-processing tools for stereoscopic image sequences. Camera motion estimation, also known as structure-from-motion (SfM) or match-moving, is an essential step in the post-processing pipeline. In order to ensure a high accuracy of the estimated camera parameters, a bundle adjustment algorithm should be employed. We...

متن کامل

Robust identification and matching of fiducial points for the reconstruction of 3D human faces from raw video sequences

We describe an algorithm for the automatic features detection in 2D color images of either frontal or rotated human faces. Such features allow to initialize robustly a bundle-adjustment in order to fit a generic 3D face model to the images. The algorithm first identifies the sub-images containing each feature (eyes, nose and lips), afterwards, it processes them separately to extract fiducial po...

متن کامل

Adaptive Spectral Separation Two Layer Coding with Error Concealment for Cell Loss Resilience

This paper addresses the issue of cell loss and its consequent effect on video quality in a packet video system, and examines possible compensative measures. In the system's enconder, adaptive spectral separation is used to develop a two-layer coding scheme comprising a high priority layer to carry essential video data and a low priority layer with data to enhance the video image. A two-step er...

متن کامل

Propagations d’erreur pour l’ajustement de faisceaux local Error Propagations for Local Bundle Adjusment

Local bundle adjustment (LBA) has recently been introduced to estimate the geometry of image sequences taken by a calibrated camera. Its advantage over standard (global) bundle adjustment is a great reduction of computational complexity, which allows real-time performances with a similar accuracy. However, no confidence measure on the LBA result such as uncertainty or covariance has yet been in...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1999